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ABSTRACT 

We consider the problem of switching in stochastic systems with delayed feedback. A general 
variational formulation is derived for the switching rate in a stochastic differential delay 
equation where the noise source is of general form. The resulting equations of motion and 
boundary conditions describe the optimal escape path which maximizes the probability of 
escape. Analyzing the dynamics along the optimal path yields exponents of the distribution 
in terms of delay time, dissipation, and noise intensity. Theoretical predictions compare very 
well with numerical simulations in both additive and multiplicative noise cases, even outside 
of regions where the delay is assumed to be small. 
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I. INTRODUCTION 

When considering dynamical systems with isolated feedback mechanisms or coupling devices to connect a network, 
there always exists a finite time for the signal to be transmitted from one device to another. Modeling such finite 
transmission times requires the inclusion of one or more delays in the dynamics. Evidence of the pervasiveness of 
delays can be seen in several reviews, such as the application of delay differential equations in many fields [if , where 



the effects of delay are seen in physics, biology, and enj 
and bifurcations is seen in several collections, such as 



ineering. The analysis of the effects of delay on stability 
Other areas involving delay occur in models involving 



populations such as epidemics [5|-l7|], engineering such is machine tool cutting and control 

Major applications and the effects of delay and noise on dynamical systems can seen in experiments and models 
from nonlinear optics, such as laser self- feedback [lot . delay coupled semi-conductor and solid state lasers 
and fiber lasers [1J|. In many of the coupled cases, zero -lag, also called isochronal, synchronization is an unstable 
state Combining delayed self- feedback along with delay coupling stabilizes the isochronal state in lasers [2], 

even in the presence of noise. 

From a modeling perspective, the interaction of differential delay with noise leads one to study stochastic effects 
on infinite dimensional systems. In approximating the phase space, finite dimensional formulations based on coupled 
map lattices were use to initially examine approximations to steady state densities [l^. Here the authors employ 
a high dimensional Perron-Frobenius formulation to extract the density in the thermodynamic limit. However, the 
drawbacks to this formulation come from the high dimensionality of the problem making analysis of the distribution 
exponents difficult, and the restriction to the type of noise that may be considered. For small delays, the stochastic 
delay problem for Wiener processes has been re-formulated using a Fokker-Planck (FP) approach [l7|, where the 
new FP equations contain a conditionally averaged drift term in the approximation. The multivariate version of the 
perturbed problem is derived in general settings in [l^ to both Ito and Stratonovich formulations. 

Noise induced switching was explored numerically in bistable potentials and has been considered in the presence of 
delayed feedback for systems modeling lasers to illustrate resonant behavior due to delayed feedback [2^ . Stochastic 
resonance in bistable systems with delay and correlated noise sources was also studied using a perturbed Fokker- 
Planck approach for small delay [2^. In addition, others have investigated noise induced switching in bistable systems 
with delay, [^lH^^ . Overall, many of the above-mentioned techniques use a perturbed FP approach to describe small 
delay effects on the probability density function. 

Rates of escape predicted from switching between co-existing stable states in the absence of delayed feedback is 
well investigated for a large variety of well-controlled systems and oscillators [^^-[s^l • Fluctuations in these systems 
are usually due to thermal or externally applied Gaussian noise. An increasingly important role may be played also 



ust a few two-state 
To reveal how 



by more general noise sources, which typically are non-Gaussian. It may arise, for example, from 
discrete particles jumping at random between the states, often characterized as telegraph noise 
switching in the presence of delay with general noise sources, we consider a different formulation from the usual 
perturbation procedure of the conditional averaged drift terms. 

Here we consider predicting the escape rates from of a basin of attraction for stochastic systems with delayed 
feedback. The approach we take is to formulate the path which optimizes the probability of escape from a stable 
state with a basin boundary. The path which optimizes the probability of escape, the optimal path, will be found 
for general noise sources using a variational formulation, originally posed for driven systems in [33|, [3J|, and recently 
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used to discuss Poisson induced switching in [351. |36||. 

The layout of the paper is such that in Sec. HI] we use a variational approach to determine the switching rate out 
of the basin of the attracting steady state. In Sec. IIIII we apply our theory to a specific example with additive noise, 
while in Sec. lIVI we apply the theory to the case of multiplicative noise. In both cases we obtain excellent fit between 
numerical simulations and the theory. We finish the paper with a discussion in Sec. [V] 



II. GENERAL FORMULATION 

We consider switching processes for the n-dimensional delay system posed as a Langevin problem: 

Mt) = F(x(t),x(f - r)) + g(x(t))C(t), (1) 

where ^{t) is a noise vector with independent components, and g{x{t)) = diag{gi{t), g2{t), . . . , g„{t)} , a diagonal 
matrix, and r > 0. Since we are studying switching from a given state, we assume that in the absence of noise that 
there exists an attracting steady state, xa, and a saddle point, xg, where the latter is on the basin boundary of xa; 
i.e., F(xa,xa) = F(xs,xs) = 0. 

General noise characterization of ^ may be accomplished through the characteristic functional [s^], where 



P«[k] = (exp 



(2) 

and where {. . means averaging over ^{t). For Gaussian noise, if D denotes the noise intensity, we characterize 
^(t) by its probability density functional V^^it)] — exp{—TZ^/D), 

= J| dtdt' i{t)Ht-t'm'), (3) 

where J^(t — t')/2D is the inverse of the pair correlator of ^{t). We also assume the noise intensity D is sufficiently 
small so that in our analysis sample paths will limit on an optimal path as D — 0. 

If we examine the tail of the distribution for a large ffuctuation, assumed to be a rare event, then the probability 
of a large fluctuation is 

■Px[x] = exp(-i?/L»), i? = min7^[x,^, A], (4) 

where 

7^[x,^,A] = 7^^K(^)] + J x{t)[k{t) - f{^,^^) - g{^{tmmt, (5) 

and Xt = x(f — r). The approach we take here is one of a Hamiltonian method, with added constraints [s^. [s^]. An 
alternative method is to use a Lagrangian description, but then one is forced to invoke an inverse function theorem 
to convert it a Hamiltonian. In many cases, as in general descriptions of finite population interactions it is 
not possible to use the Lagrangian approach. In the general formulation above, the Lagrange multipliers, X{t), 
correspond to the conjugate momenta in the Hamiltonian derivation. They will turn out to be a deterministic model 
of the effective force of noise on the system, which drives dynamics towards the saddle, xg, from the attracting state, 
XA. Once sufficiently past the saddle, the deterministic dynamics takes over and the process of escape is completed. 



A. Equations of motion describing the optimal path 

From here on, we concentrate on the case where we have a scalar state variable, x, and the noise is delta correlated 
in time. However, it is clear that the resulting equations of motion derived may easily be extended to the general 
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vector case. To determine the exponent, TZ, we seek the equations which describe the maximum probabihty of the 
reaching the state at xs if the initial state is xa, where the exponent to extremize is now given by 

nx,iA] = \j ^\t)dt + j \{t)[x{t) - F{x,x^) - g{x{t))m]dt. (6) 

We derive the variation (STZ) by varying deviations from the path that minimizes TZ. We start with the variation 
with respect to the noise (^(i)). 

^ = 7^[s,C + r?,A]-7^[x,C,A] (7) 

= ^/ [{^ + rif~e]dt- I \[g{^ + v)-9^]dt (8) 

= Ji^-Xghdt + Oir,^). (9) 

Since rj is an arbitrary smooth function, we have 

e = Aff. (10) 

Using similar arguments, we find the variation with respect to the Lagrange multiplier {X{t)): 

x = F + g^. (11) 

Finally, we find the variation with respect to x. Here the delay is crucial in that it will introduce an advanced 
term in the equations of motion. The variation is given as: 

= 7^[x + ry,C,A] -7^[x,C,A] 

= / A(t) [v - (F(x + ?y, + r?) - F{x, x^) ~ [g{x + 77) ^ 9{x)M dt 



SF(x,Xt) SF(x,Xr) 5q(x,Xr) ^ 

V -J -V 7 -V h -V^ 

ox oXt ox 



dt + 0{n). (12) 



Using integration by parts in the usual way, and rescaling the limits we derive the equation of motion: 

- A - X{t)^{x,Xr) - \{t + T)^^{X-r,x) - A(t) || (x)?(f) = 0. (13) 

The three coupled equations derived above may be rewritten as a second order system: 

i = \g^{x)+F{x,Xr) (14) 

A = -X'^g{x) — {x) - \ — {x,Xr) - \-r-g^{X-r,x), (15) 

which has Hamiltonian 

H{x,Xr,X)^^^^^+XF{x,Xr). (16) 

Notice the appearance of advanced terms in the equations of motion. The equations of motion in this formulation 
are given by: 

dH 

Xo = -—{Xo,po,XOr) 

op 

dH OH 

PO = --q^{xo,Po,XOt) - -Q^{xo{t + T),po{t + T),Xo(t)). (17) 

An alternative derivation of Eq. [17] is presented in the appendix for arbitrary dimensions. When using the small 
noise techniques for n-dimensional stochastic systems without delay, the additional conjugate momenta doubles the 
phase space to 2n. Attractors become saddles, and saddles remain saddles but in 2n-dimensional space. If delay is 
now included, we discover the equations of motion contain both retarded and advanced terms both of magnitude t, 
effectively doubling the time history to 2r as well as the phase space dimension to 2n. 
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B. Boundary Conditions 

Recall that in the absence of noise {£,{t) = 0), F has two steady states: an attractor and a saddle; i.e., F{xa, xa) = 
F{xs, xs) = 0. Taking the limit as f — >■ oo, we assume x{t) — > xa, ^{t) — >■ 0, and X{t) — >■ 0. For escape from the basin 
of Xa, as t ^ oo, we assume x{t) — >■ xs, ^{t) — > 0, and X{t) — >■ 0. 

To verify the conjugate momenta have the right limits, we linearize Eq. p5[) about steady state values: 



at 



where x is either xa or xs- Assuming A = e 

OF dF 

9j'-''''^''"''""aJ7^^'^''"°' ^^^^ 
We impose sufficient conditions on F so that the linearized solution has the correct asymptotic limits when the delay 
is small. More specifically, for the examples we consider in the following sections, we use Eq. (|19p to compute the 
growth constant a and confirm that we obtain the correct limiting behavior under the influence of noise. 



C. Computing the exponent along the optimal path 

With the assumptions above for the equations of motion and asymptotic boundary conditions, computing the 
action TZ requires the solution to the two point boundary value problem. We suppose that the solution exists for 
the problem when r = 0, and that solutions for non-zero delay remain close to the zero delay solution. We do not 
necessarily need to assume the delay is small, as done in [3]. Then we may compute perturbations to the action. 

In order to compute the correction to the action, assume that perturbations to the optimal path when r 7^ 
remain small. That is, if x{t) is the solution when t — 0, then the perturbation STx{t) = x{t) — x{t — r) should 
remain small. We will need to put conditions on the growth of a general nonlinear function, F, so also assume 

\F{x,x) — F(x,Xt)\ ~ K.\x — Xr\- 

The action may now be expressed as the following perturbation problem: 

7^[a:,C,A] =7^o[a;,5,A]+7^l[x,C,A], (20) 

where 

Tlo[x,i,\] = \j e{t)dt + j \{t)[x{t) ~ F{x,x) - g{x{m{t)]dt (21) 
7^l[2:,C,A] = I X{t)[F{x,x)- F{x,Xr)]dt. (22) 



The minimizing solution is solved by first considering the equations that minimize TZo, denoted by [xo, ^o, Xo]- The 
first order correction is then evaluated at the zeroth order solution. The minimizing solutions satisfy 

Xo = Xog^{xo) + F{xo,Xo) (23) 

Dq of of 

Xo = -Xlg{xo)^{xo) - Xo^r-{xo,Xo) - Xo- — {xo,Xo)- (24) 

ox ox OXt 

The general solution to Eq. (|21|) will have the form 

Xo{t) = _2 -^(^°W'^°W) ^ and Xo{t) = -F{xo{t),Xo{t)). (25) 

In the next two sections we will consider a specific example of F for both additive (17(2:) = 1) and multiplicative 
{g{x) — ^/x) noise. Using Eqs. (|23 [l -(|25 p we compute the action, TZ, and then the switching rate out of the attracting 
basin. 
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III. ADDITIVE NOISE SWITCHING 



A natural place to discuss the escape rate is to consider additive noise; i.e., g{x) = 1. For additive noise, either 
the Hamiltonian or Lagrangian formulation will work to describe the trajectory of the switching optimal path. For 
additive noise, the second order delay system in Eq. (|14p is equivalent to the equations of motion derived from the 
Lagrangian, L, which is presented in the appendix. In the following example, we use the variational formulation to 
find the escape rate exponents for a scalar delay example. 



A. Analysis for a given function F: 



As an example, consider F{x,Xt) = x{l — x) — jXt, where the steady states are xa = 1 — ^, xs ~ 0, and 
< 7 < 1- We first analyze the stability near equilibria to verify that X{t) approaches as t — > ±cxd. Let A{t) be the 
linearized solution to Eq. (|19|) about the steady states. Assuming A(t) = exp{at), for small r we find that near xa, 
a — IZr-y 0' ™Plying A(t) — as f — j> — oo. On the other hand, in a neighborhood of xs we find a — —^37^ < 0, 
and A(f) — > as f — s> oo. 

To compute the optimal path from xa to xs that minimizes TZo, we use Eq. (|25p . which for g{x) — 1 are 
Xo{t) — —F{xo{t),Xo{t)), and \o{t) — ~2F{xo{t),Xo{t)). From Eq. (jlOp we also have that the optimal noise is 
given by ^o(t) = Xo(t). For the example F{x,Xt) above, TZo has as its solution Xo{t) = XA/{i + e^'**). Notice that 
limt^oo Xo{t) — = Xs and limt_>_oo Xo{t) — 1 — j — xa- In addition, it easy to show TZo ~ a;5i/3. 

Using F{x,x) — F{x,Xr) = —"/{x — Xt), we now find the first order action, 

/oc 
Xoit){Xo{t) - Xoit - T))dt. (26) 
-oo 

Substituting for xq, the first order results for the action are now given by, 
The full action to first order in 5x{t) is then 

Recall Xa = 1 — j. Asymptotically, the expression for small r becomes: 

nr)^^-^-^il-ir) + 0{r'). (29) 
This is our relationship for the action on the delay. 



B. Numerical Comparisons 



We now compare the theoretical results with numerical simulations. In particular, we have computed the mean 
switching time as the noise drives the system out of the basin of attraction of XAiox<xs- In each of Figs. [T]|3]the 
solid curve represents the theory, while the data points are the mean values taken over 1000 simulations. To insure 
that trajectory doesn't drift back to the original basin we require that the trajectory be driven well past xs- More 
specifically, we define the switching time to be when x < —0.2 and find that this threshold gives consistently good 
results. 
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The switching rate is proportional to the probabihty of large fluctuations Px[x], Eq. (Q, and is given by 

Ws = ce^p{~R/D), (30) 

where for R we use the minimum value given by Eq. (I29p . The switching time is simply the inverse of the rate and 
so Ts = 1/W . When plotting Tg on the logj^g scale, the constant c corresponds to a vertical shift in the theoretical 
result. Because we are using Gaussian noise, we compute the prefactor c based on Kramer's theory [s^ and find 
that it is given by c = 27r(l — 7r)/(l — 7). 

In Fig. [1] we plot the switching time as a function of the inverse of the noise intensity. We see that, as expected, 
when the noise intensity is increased the switching time decreases and we have excellent fit between the theory and 
simulations over four orders of magnitude. In the top curve the delay is set to zero so that F{x,Xt) = F{x,x), while 
in the bottom curve the delay is r = 0.5. We see that even though r is not appreciably small we still have excellent 
fit over the entire range of the noise intensity. Further, the effect of the delay is to decrease the switching time or, 
in other words, the delay increases the probability of switching. 

In Fig. [2] we fix the noise intensity at two different values and vary the delay r. As mentioned above, increasing 
the delay decreases the switching time and our theory based on small t maintains good fidelity up almost t — 1; for 
T > 1 the theory and simulation results begin to diverge. 

In Fig. |3]the delay is fixed but the strength of the delay term 7 is varied from zero to almost one. Recall that 
a::^ = 1 — 7 so that increasing 7 moves the attractor closer saddle steady state. The effect is that the noise has to 
drive the system a shorter distance before switching occurs and, hence, the switching time decreases. We note that 
the theoretical curve deviates from the simulation results as 7 gets close to 1; this is due to a singularity in the 
expression for the shift constant c. 

Finally, the results for the switching time as a function of 7 provide insight into why, for this system, the delay 
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1/D = 1/noise intensity 



Figure 1: Log of escape time vs. inverse noise intensity (7 — 0.1). The solid curve represents the theory 
from Eqs. ([29| - (|30p . vifhile the data points are the mean values taken over 1000 simulations. 
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0.2 0.4 0.6 0.8 1 

X = delay 



Figure 2: Log of escape time vs. delay (7 = 0.1). The solid curve represents the theory from Eqs. ((29| - (|30|) . 
while the data points are the mean values taken over 1000 simulations. 
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0.2 0.4 0.6 0.8 

Y= delay coefficient 



Figure 3: Log of escape time vs. dissipation (t = 0.1). The solid curve represents the theory from Eqs. (P^]) - 
(pO)) . while the data points are the mean values taken over 1000 simulations. 

decreases the switching time. For small x the deterministic repulsive force of the saddle is 

X ^ X — 7a;(t — r). (31) 

For larger r the second term takes values of x further back in the history of x, which because x is generally decreasing 
from xa to xs = 0, are larger. The second term being larger decreases the repulsive force of the saddle. Thus, as we 
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1/D = 1 /noise intensity 



Figure 4: Log of escape time vs. inverse noise intensity (7 — 0.1). The solid curve represents the theory 
from Eqs. (pO| and ((35)) . while the data points are the mean values taken over 2000 simulations. 

have found, the delay makes it easier for the noise to drive the system out of the basin of xa and the switching time 
decreases. 



IV. MULTIPLICATIVE NOISE SWITCHING 

We now consider the switching rate for multiplicative noise to illustrate the generality of the variational ap- 
proach. Let the multiplicative function be g(x) = y^. The path that minimizes Eq. (|2ip satisfies \o{t) = 
— 2F{xo{t),Xo{t))/g^{xo{t)) and Xo{t) — —F{xo{t),Xo(t)). For the example F{x,Xr) above, TZo has as its solution 
Xo{t) = xa/{1 + e"^-^^) and \o{t) = -2(1 ~ xo - 7). We evaluate 

n,='-r (^^~n^o,-A \t=ir t^ii^^dt = xi (32) 



Using F{x^x) — F{x,Xt) = —'y{x — Xr)^ we now find the first order action, 

7^. = -27 r fA^E^^^l^fAl^dt (33) 

J -co Xo(t) 

After substituting for xq and evaluating the integrals for TZ, and 7?.oo, we find that 

n{r)^x\-2^(^-XA + ^^^y (34) 

Asymptotically, the expression for small r becomes: 

TZ{r)^x\{l--fr) + 0{T^). (35) 

Again, we compare the theoretical results with numerical simulations. For multiplicative noise, we have computed 
the mean switching time as the noise drives the system out of the basin of attraction of xa to x < xs- In each of 
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T = delay 



Figure 5: Log of escape time vs. delay (7 — 0.1). The bold solid curve represents the theory from Eqs. (PU]) 
and ([35]). and it is shifted vertically by -0.07 and plotted as the light solid curve to show agreement with 
the data in rate of change. The data points are the mean values taken over 2000 simulations. 

Figs. l4l6l the solid curve represents the theory, while the data points are the mean values taken over 2000 simulations. 
To insure that trajectory doesn't drift back to the original basin we define the switching time to be when x < —0.01. 
To find the theoretical switching time, we approximate the switching rate using Eq. (|30p . with the minimum TZ given 
bvEq. psp . and the switching time is Ts = 1/W . Here we use the shift given in the case when the delay is small 

Q. 

In Fig. |4l we plot the switching time for the multiplicative noise case as a function of the inverse of the noise 
intensity. As expected, when the noise intensity is increased the switching time decreases. In the top curve the delay 
is set to T = 0.1, while in the bottom curve the delay is r = 0.5. As before, the effect of the delay is to decrease the 
switching time or, in other words, the delay increases the probability of switching. 

In Fig. O we fix the noise intensity at three different values and vary the delay r. There is a small shift offsetting 
the data and the theory. In this figure, the theory was shifted vertically by -0.07 and replotted by the light black 
solid curve to show agreement with the data in rate of change. Our theory based on small r maintains good fidelity 
up almost T = 0.5; for r > 0.5 the theory and simulation results begin to diverge. 

In Fig. |6] the delay is fixed but the strength of the delay term 7 is varied from zero to almost one. We note 
that the theoretical curve deviates from the simulation results as 7 gets close to 1; this is due to a singularity in the 
expression for the shift constant c. 
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Figure 6: Log of escape time vs. dissipation (r = 0.1). The solid curve represents the theory from Eqs. (pOl 
and (j35p . while the data points are the mean values taken over 2000 simulations. 



V. CONCLUSIONS 



We considered the problem of noise induced escape from a basin of attraction in stochastic systems having 
differential delay. The formulation for determining the escape was posed as a variational problem along an optimal 
path, which maximized the probability of escape. Since noise escape from a basin of attraction is a rare event, the 
optimized solution to the variational problem holds in the tail of the distribution. The scaling results derived are 
therefore based on using the optimized path to escape. 

In contrast to many other approaches which consider Gaussian processes, the approach considered here is quite 
general in that it allows for any general noise, such as Poisson, Schott, or colored noise. It generalizes the problems 
of non-Gaussian noise induced escape considered in [ssl. [s^. [41! by extending the formulation to include delay. 

We applied the theory to scalar problems with both additive and multiplicative noise to explicitly compute the 
solution of the optimal path to escape. With the optimal solution in hand, we derived relations describing how the 
escape rate scales with respect to various parameters, such as delay, dissipation, and noise intensity. The perturbation 
theory used in the analysis was based upon a Melnikov approach. Here, the delay itself does not need to be small, 
but the escape path with delay is assumed to remain close to the path with no delay. Then, a first order correction 
to the integral along the optimal path may be computed. 

The escape rate results found analytically were compared in each case to numerically simulated solutions. Even 
though a small delay approximation is used to explicitly compute the escape exponents, we find excellent agreement 
between theory and simulation for large delay, even when they are of order unity. Specifically, in some cases for the 
examples considered here, the escape rate agreement between theory and numerics holds for delays much longer than 
the relaxation time of the system. 

Finally, in comparing the numerical simulations to the theory, we show where theory and numerical simulations 
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diverge. We expect that the approach considered here will shed light on many other escape processes where the 
stochastic forcing renders the problems non-Markovian in nature, as well as many other applications physical and 
biological experiments. 



We gratefully acknowledge support from the Office of Naval Research. 
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VI. APPENDIX 
A. Lagrangian formulation 

The Lagrangian, i, and its corresponding second order equations of motion for a stochastic differential delay 
equation are given by: 

L{x,x,x^) = h^x{t)- F{x{t),x{t-T)f, (36) 
dL . d dL . \ _ 9L . 

_^^:C,X,Xr) - --^[X,X,Xr)--g^{X.r,X.r,X). [67) 



B. Derivation of Delayed Hamilton's Equations of Motion 

When considering the Hamiltonian with delay, new equations will describe the momenta due to the addition of 
a time delay. This is now derived, and shows how the advanced time terms arise. 

We begin by assuming the Lagrangian, L{x,x,Xt), of the systems is defined as a function of state vector x, 
velocity x, and delayed state x-r = x{t — r). The action is defined as 

oo 

J[x,x]—min J L{x,x,XT)dt. (38) 

— oo 

The minimization is taken over all paths perturbed from the true minimum, assuming it exists. Defining the 
Hamiltonian using the usual Legendre transformation, we have the following minimization problem: 

oc 

JH[x,p]=min J (px — H{x,p,XT))dt, (39) 

— oc 

where p = ^{x, x, x-r). We assume sufficient hypotheses so that the inverse function theorem applies. We let the 
optimum path by given by cc = Xo{t),p = po{t), and consider smooth perturbations from the path as r]{t),^{t), 
respectively so that lirat^±oo'n{t) — 0, and similarly for ^{t). That is, the perturbed paths satisfy the natural 
boundary conditions. 

Consider the variation from the path: 

SJh[xo,Po] = J[xo + ri;Pt> + i] - J[xo,Po] (40) 

OO 

f , . . . dH , , dH , 

= J [pori + xo^- -Q^(xo,po,xor)'n- —(xo,Pa,xaT)i 

— OO 

-(a;o,Po, xor)'nr]dt + 0[|»7|' + |^|']. (41) 



Using the following identities. 



dxr 



porjdt — — por]dt 



dH f dH 

-^^{xo,po,xoT)r)Tdt = / -^^(xo{t + T),po{t + T),xo{t))r]{t)dt, 
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we have that 

/dH 
[{Xo -—(xo,PO,Xo-r))^(t) 
dp 

— OO 

OH DH 
-(po + -^(xo,Po,Xot-) + -Q^i^oit + r),po{t + T),Xo{t)))7]{t)]dt 

Since the perturbations to the path are arbitrary, we get Hamilton's equations of motion for a delayed stochastic 
system given by Eq. (|17p . 

dH 

Xo = ——(xa,Po,xoT) 
op 

dH dH 

Po = —-^ixo,Po,xoT)--^ {xo{t + T),po{t + T),Xo{t)). (42) 



